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RULE 131 DECLAR A T ION 

Commissioner of Patents and Trademarks 
Washington, DC 20231 

Dear Sir 

I, Harold Fujij, declare as follows: 

Joseph Chan is the original inventor of the invention claimed in the abcve-caitfioned 
application. Mr. Chan is no longer employed by the present assignee, Sony Etectrontes Inc.. and his 
present whereabouts are unknown. 

As evidenced by the enclosed Sony Invention Disclosure form signed and datec by Mr. Chan 
April 5, 2001 , Mr. Chan conceived of the present invention at least prior to July 1 0, 2001 . Specifically, 
using the limitations of Claim 1 as an example and referring to the enclosed Sony Invention Disclosure 
form and in particular Figure 1 thereof, Mr. Chan conceived of a method for ccncea ing «iTors in 
texture partition of a video packet that includes determining a particular macrob ock within the) texture 
partition where error is detected (step 1 in Figure 1). concealing the error starting at he particular 
macroblock (step 4), and then evaluating image smoothness of concealed macroblo=ks (.step 5). 
Figure 1 also shows repeating the concealing and evaluating acts with one nore macrr>btec< added 
prior to the previous particular macroblock (step 6, wherein K is increments, and the dsctefcm 
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diamond immediately following, wherein if the loop is not ended the procerus loops back step 4). 
Figure 1 shows that the repeating is done until aQ macroblocks En the texture partit on have been 
concealed. Note that because N macroblocks are stored at step 3, and K is initialized at step 2 as i 
being the location of the error, incrementing K results in obtaining the macrobfock adc ed prior to the ; 
previous particular macroblock, see also the explanation of these steps in paragraphs 3 and 7 of the j 

enclosed document The enclosed document further describes selecting the set of maoroblocks, i 

i 

including a combination of decoded and concealed macroblocks, th;it produce* teat image 
smoothness* see tn particular the last sentence of paragraph 5. i 

The enclosed document also shows features of the dependent claims. j 

i 

I declare that Mr. Chan was diligent in reducing the invention to practise at fee st frnm a time I 
prior to July 10, 2001. Specifically, I declare that Mr. Chan submitted the enclcsed invention j 

.disclosure prior to July 10, 2001 to Sony Intellectual Property Department, which then diligently ! 

i 

processed the application for disclosure to outside counsel and subsequent filing wthin the usual 
course of Sony business in filing patent applications. 

I hereby declare that all statements made herein of my own knowledge are true and that an 
statements made on information and belief are believed to be true; and further that the so statements 
were made with the knowledge that willfui false statements and the like 30 made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United State Code and that such 
willful, falsg^tatemente may jeopardize the validity of the application or any patent issued t'->?reon. 

BY: Refold Fujii/date ~ 

Vice President, Intellectual Property, Sony Electronics, Inc. 

11Q0-T21.DEC 
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Respectfully submitted, 




John L. R6gitz " ~ ~ 
Registration No, 33,549 
Attorney of Record 
750 B Street, Suite 3120 
San Diego, CA 92101 
Telephone: (619)338-8075 
JLR:jg 
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Invention Disclosure Data Sheet 



A. Exiting problems 

Jn an MPEG-4 decoder used for real-time streaming, when an error in a video packet, all decoded texture 
information of the packet b usually discarded. The region of the video frame corresponding ts this corrupt :c p«:ket 
is then generated by error concealment process. Motion compensated temporal replacement to usually an » 3tan- s 
error concealment technique. However, there are times when the texture cannot be adequately coaoealcd ji st by 
copying texture from previous frame at jomc motion compensated displacement 

B. Invention description 

In concealing corrupted video packets, the decoder attempts to utih'ae uneorrupted received tc;ture mfcona Ion. 
Macrodlock boundary matching is evaluated for varying amount of utilized texture informal ten. The final ; anoutit 
of utilized decoded texture information (the recovered information) is selected to maximize overall boaadn y 
matching. The flow chart of this process is shown In Figure t. 
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Figure 1 : Error concealment -with texture data recovery flowchart 
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The numbering of the following sections are descriptions of the steps in Figure 1 with same numbering. 

(1> £5 ofaTde^Scan be detected if invaUd variable length code f^LC). 

fhp lAcfttion where the decoder detects an error (i.e. where invalid vl,u occur; is usium/ ^ 
l^bta^ta. where the actual start of the error. Figure 2 shows an example of a corrupted v.deo 
packeL The techniques for packet error detection are outside the scope of this invention. 
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Figure 2: Example of corrupted video packet 



(2) JisTntolLd to the number of macroblocks in the packet that was decoded after the first detected error of the 
packet. This initial value of AT will be the least number of macroblocks that will be concealed. 

(3) Store Decoded Texture . 

In MPEG a video frame is divided into macroblocks. Each video packet contains information for consecutive 
macroblocks from left to right and then top to bottom. The number of macroblocks (N) represented by each 
video packet can be determined by the change in macrobtock number field of the video packet header. 

In this step, the. decoded texture (luminance and chrominance information) of the first N-K macroblocks is 
stored in temporary buffer. This will be used later in step (7) 



(4) Conceal Last if macroblocks: 

The last K macroblocks of current packet is concealed by a technique such as decoder motion estimated 
temporal replacement (described in IPD 50P4109.01), the first N-K macroblocks may or may not be considered 
as corrupted inside the concealment process. 
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(5) Evaluate MacroMock Boundary Matching: 

^ZZSZ^™/ am ^^> P«k« macroWocks <s abated, fa dm step, tfa s fiwiV-r 
c^taafog bwndmy matching fa by swrming the pbc 8l value mtawtri. between mXfock bound* ? Jri » 
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F!pnre3i Macrpblock pixel values 



By storing the partial sum of mismatch values (mismatch values for <*cb roacroblcck), the nrti of roim land 
vaiues to each iteration of this step can be computed more officientty by reusing ths parial m sm.tteh v ,h;*3 
worn previous iteration for macrobiotics that did not change. 

T 7 / <* ndw ' ca » bc "** d * w ^Sh the boundary mismatch betwseo nMhlocto bel urti 
to ojffferent video packets more, ^ - 

2l^l^ t ^i r ° dUCeS th ? b ?f ovcra11 "«tehmg (smallest sum of botmdk? pixel misrr ateh ihr 

aij macro5toflts of the corrupted video packet) U stored 33 K^st later us* m step (7). 

(6) Increments 

The variable K is incremented by 1 and Steps (4> and (5) ere repeated with one mor- macn*k ck coacet J*d 
this occur* until a is A, in which case the all tnacroblocks arc concealed. 



(7) Setact combination of concealed and recovered macroblocks 

The texture of the first AWC^ mscrobiocks Is restored from the temporary buffer created rn • tep Q\ 'hz 
texMire of these macroblocks is the recovered tcxtare. 
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